100 



130 



101 



11 



105 



107 



Encoder 



109 



Decoder 



115 U7- 



A 



119 



V 



V 



□ 



113 



125 



Figure 1A 



103 



□ 



121 



105 



109 



Decoder 



107 



Encoder 



iQ3i23 



133 



135 



Encoder 



137 



131 



Server 



139 



141 



145 



□ 



143 



Decoder 



Figure IB 



200 



202 ! 



Enhancement Layer Encoding 

231 



229 



233 



235 



DCT 



». 


Frequency 


> 




Weighting 





VLC 



Base Layer Encoding 207 
2f " 



£05 



209 



211 



•6> 



DCT 



f H 



227 



Motion 
Compensation 



225 



Motion 
Estimation 



223 



Frame 
memory 



VLC 



215 



IQ 



217 



IDCT 



22] 



•0 



Clipping 



219 



Figure 2 
(Prior Art) 



300 




Base Layer Encoding 207 
205 



209 



> DCT 



305 



211 





Q 




X, 


p, 


1 





305 



'227 



Motion 
Compensation 



225 



Motion 
Estimation 



223 



Frame 
memory 



VLC 



215 



IQ 



217 



IDCT 



221 



■e 



Clipping 



219 



I 



Figure 3 



400 



403 



Enhancement Layer Decoding 
419 421 



423 



237 



VLD 



BP 
Shift 



IDCT 



425 



427 



Clipping 



-> 429 



401! 



Base Layer Decoding 



213- 



* 

VLD 




IQ 




IDCT 


4( 


39 


Clipping 


— ► 


— ► 


-< 

i 





-►413 



417 



Motion 
Compensation 



415 



Frame 
memory 



Figure 4 
(Prior Art) 



500 



503 



Enhancement Layer Decoding 
419 507 



423 



311" 



VLD 



IQ 



IDCT 



425 



427 



Clipping 



->509 



501 ! Base Layer Decoding 



403 



309" 



VLD 



405 



407 



IQ 



IDCT 



409 



411 



Clipping 



->505 



417 



Motion 
Compensation 



415 



Frame 
memory 



Figure 5 



603 



707 




600 



601i Base Layer Decoding 
403 



405 



705- 



VLD 



IQ 



407 



DDCT 



409 



415 



Frame 
memory 



425 



->605 



Figure 6A 



700 



701 i Base Layer Encoding 
205 



203" 



>707 




Figure 7A 



610 



717- 




611 



715- 



Base Layer Decoding 

403 405 



VLD 



IQ 



409 



415 



Frame 
memory 



407 



> 0 > IDCT 



425 



I 



Figure 6B 



710 



711 



Base Layer Encoding 
207 



203- 



DCT 



205 



713 




J 



209 



x-305 
^ ► 



305 1 2 



IQ 



223 



Frame 
memory 



219 



211 



VLC 



Figure 7B 



620 



623 



Enhancement Layer Decoding 
419 



727 



> VLD 



611 



Base Layer Decoding 
403 



725- 



VLD 



409 



f w 



415 



Frame 
memory 



405 



407 



425 



IQ 



IDCT 



"*625 



i * 



Figure 6C 



720 



723 



711] Base Layer Encoding 

207 209 



203 — !— > T>CT 



> Q 




223 



Frame 
memory 



19 



*727 



-►725 



Figure 7C 



800 



FGS Encode ) 



1 


, 801 


Remove base 
layer temporal 
redundancies 




, 803 



Transform 
input 



4 805 

Remove base ! 
layer temporal j 
redundancies | 



j 807 

Quantize 
transformed 
result 



Fractional parts /\* uy Integer parts 



1 


r 811 


\X 4 815 


Encode 


! Remove base ! 


fractional 


; layer temporal j 


parts 


1 redundancies J 



4 813 

Output encoded 
franctional parts as 
enhancement layer 
bitream 



j 817 





Encode 






integer parts 




1 


r 


819 



Output encoded 
interger parts as base 
layer bitream 




-MEndk- 



Figure 8 



FGS Decode 



I 90_ 



Decode 
enhancement 
layer bitstream 






, 903 




Apply inverse 
quantization 






, 905 



Apply inverse 
transformation 





, 907 




Decode base 
layer 
bitstream 






, 909 


Apply inverse 
quantization 






r 911 



Apply inverse 
transformation 



I 913 

Restore base 
layer temporal 
redundancies 



915 



— ► 


Apply enhancement 
layers to modifed 
base layer 





j 917 

Output video 
stream 



Figure 9A 



FGS Decode^ 



I 90 

Decode 
enhancement 
layer bitstream 



j 907 

Decode base 
layer 
bitstream 



| 903 

Apply inverse 
quantization 



j 909 

Apply inverse 
quantization 



j 913 

Restore base 
layer temporal 
redundancies 



915 



fc. 


Apply enhancement 
layers to modifed 
base layer 





921 



Apply inverse 
transformation 



4 923 

Output video 
stream 



Figure 9B 



930 



I 



90 



Decode 
enhancement 
layer bitstream 



(FGS Decode) 



I 907 

Decode base 
layer 
bitstream 



1 913 



Restore base 
layer temporal 
redundancies 






915 


Apply enhancement 
layers to modifed 
base layer 






r 931 






Apply inverse 
quantization 








r 933 




Apply inverse 
transformation 





I 935 

Output video 
stream 



Figure 9C 



if 

(End) 



1001 



1009 



Memory 



1005 



Processing 
Unit 



1007 



1011 



Display 
Controller 



▼ 1013 



Display 



I/O Bus 



101 5 

Non-volatile 
storage 



1017 



I/O 
Controller 



I 



1019 



I/O 
Devices 



1003 



Modem or 
Network 
Interface 




Figure 10 



